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Introduction 



The assessment of a student *s ability to speak in a foreign 
language has always been one of the tnost difficult tasks 
that the foreign language teacher must carry out. During , 
the height of the use of the audio lingual approach to 
language teaching, various methods and techniques were 
designed to evaluate the speaking skills* These tests 
concentrated on the evaluation of such discrete linguistic 
items as stress^ intonation patterns^ and the pronuncia- 
tion of isolated soiands, or the correct oral production of 
isolated graiDjnatical Teatures of the foreign language* 
Recent research has sliown^ however^ that the evaluation of 
the ability to correctly produce discrete oral features 
does not necessarily give the best indication of a stu- 
dent ^s ability to use the foteign language for the purpose 
of cojiimuni cation (e*g., Barti 19*4, Schulz 1974). Although 
teachers obviously want to evaluate their students* pro* 
nunciation and graimiiar, the evidence in the literature on 
testing language proficiency points to the need for going 
beyond the testing of discrete oral features. 

Speaking in a foreign language involves more than being 
able to pronounce correctly, to put the stress on the 
correct syllable^ or to supply the correct verb forms or 
endings* Rathcr> oral conununication involves the combina- 
tion of many skills and depends on the student's ability 
to synthesize— not just to produce in isolation— discrete 
linguistic components* Forei^^n language teachers, like 
their colleagues in other areas, often forget that students 
perceive the priorities of a course by what is tested* 
*rhus, if the tests in a foreign language class evaluate 
only oive skill or one aspect of a skill, students may con- 
sider other important aspects of the language unworthy of 
attention* 



In spite of the emphasis placed on the oral skills during 
the 60s and the 70s, many foreign language teachers still 
do not test their students^ speaking abilities. The 
listening component of the oral skills, however, does seem 
to receive more attention in today's classroom. The rea- 
son for this is quite obvious if one looks at the ways in 
which these, two skills can be evaluated. Jones (1977) has 
pointed out, "In educational measurement a distinction is 
frequently made between knowledge tasts and performance 
tests ." The distinction between the evaluation of the 
listening and speaking skills is basically one of "knowl- 
edge" versus "performance." In order to evaluate the 
listening skill, an objective paper and pencil instrument 
can be designed; however, the evaluation of the speaking 
skill is a much more subjective and time-consuming process. 
The evaluation of oral communication in -he foreign lan- 
guage must, however, involve a combination of both these 
skills. 

The development of the oral skills in foreign language 
learning can roughly be viewed as a process involving two 
basic levels— the "linguistic" level, in which the student 
acquires the skills necessary to perceive and produce 
grarajnatically correct utterances, and the "communication" 
level, in which the student acquires the skills necessary 
to carry out oral communicative interactions. 

Techniques and examples for testing the oral skills on a 
linguistic level are abundant and quite well defined in 
the professional literature (see Lado 1961 and Valette 
1977). Techniques and examples for testing on the commu- 
nicative level, however, are just beginning to emerge. 
Ihis paper will attempt, therefore, to give teachers some 
ideas for developing their own testing techniques for the 
evaluation of their students' oral communicative skills. 

In the construction of communicative tests (or any other 
'tests, for that matter), four important aspects must be 
taken into consideration initially: face validity, con- 
tent validity, administration, and scoring. 

Face Validity 

In order for a t-est to be a true measure of communicative 
ability, students must feel that they are performing a 




"real" communicative "act, and that thby are being evalu- 
ated on criteria that do indeed measure the degree of their 
"success in coiuniuni eating. Thus, any test thvit attempts 
to measure communicative ability and that strives for some 
degree of face validity should involve a communicative • 
situation. Because it is difficult to provide within the 
classroom a "real" situation— that is, interaction with a 
native speaker in the native contcxt--the coiwnunicativc 
situation will almost always have to be simulated. Since 
'tests, as stated previously, indicate to the students the 
priority placed on course objectives, tests measuring 
communicative ability must be as realistic us possible; 
otherwise they will convey a distorted message to the 
student concerning the goals of the course. Below are 
some examples of the use of a communicative situation in a 

tCbt . 



Speaking Test 

Pretend that a German (French, Spanish, etc.) student 
is living with you and will be attending your school* 
for a semester. Although her program has boon 
arranged, she would like to know what your daily 
class schedule is so that she can get permission to 
visit some of your classes tomorrow. Organise your 
thoughts and give a description of your schedule, 
including the times (class periods), the subjects, 
and the teachers. 



Listening Tests 

1. You are staying in a foreign hotel and are alone 
in your room. Your friend who is traveling witli you 
has gone out to do some shopping. The telephone 
rings, you answer it, and after appropriate greeting, 
the' party on the line asks to talk with your friend, 
iou try to tell the caller that s(he) is not there, 
but he insists on giving you a message. You- hear him 
say the following. Listen carefully and take notes 
in English. Tnci; write in English your message for 
your friend* (Telephone message is read in the for- 
eign language by the teacher to the students.) 

'2. You arrive at the airport in Madrid (Berlin, 
Paris, etc.). Not knowing how to get to your hotel, 

3^ 
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you ask tor instructions from one of the people 
standing near the main entrance • He gives you direc** 
tions* On the attached map^ fpllow tlie instructions 
you will hear and mark with an X the building he 
identifies as your hotel* The directions will be 
given twice* (Tl)e student has a copy of a simplified 
map of the appropriate cityO 

Administration : The directions are read twice> 
with adequate pauses^between sentences so that 
the students can follow on their maps the 
instructions they hear. 

Suggested Scoring : Give three points for each 
direction correctly followed up to the point 
where the student gets ^^lostJ* 



Each test item above simulates a coimnunicative situation. 
In this way, students are made aware that their perfor- 
mance is taking place in the context of a ^^real-life*' 
situation^ Such simulation can be accomplished by 
describing the communicative situation for the student in 
the introductory instructions to the test item. 

A type of test that does not necessarily require a commu-- 
nicative setting, because the design of the test itself 
creates a communicative situation, is the interview test. 
Two examples follow below: 



Interview (providing information) 

You will be asked some questions about your home. 
Try to give as much information as you can. If you 
do not understand a question, you may ask in Cerman 
(French, Spanish, etcO to have it repeated. 

Adminis tration : Ask each of the following questions 
. once* Repeat or restate only if the student requests. 
Be careful to keep a logical sequence of questions* 
If a student^s answer warrants it, reword a question 
to preserve coherence in your dialogue with the stu- 
dent* (The questions are in the foreign language.) 



1* Where do you live? 



2* Do you live in a house or an apartment? 

3* How many rooms does your house (apartment) 
have? 

4^ Name each room and at least three pieces of 
furniture in each* 

5* Tell me more about your bedroom* Describe 
all the furniture* What color are the 
. . A^ralls? Do you sh*^ e the room? 

6* In which room do you spend most of your 
time? 

7» Where do you usually do your homework? 

8* In which room(s) do you have a television 
set? 

9. Describe your living room and the kind of 
furniture in it, 

10* Describe the outside of your house (apart- 
ment) : colors, number of stories^ etc* 

Suggested Scoring : The most feasible and appropriate 
method of scoring an interview of this lype is to 
use a rating scale as described on pp» 18-22. 

Interview (soliciting infoimdatioh) 

Wo will pretend that I am a foreign student visiting 
,your school and that you have been assigned to get 
some information from me for the school sewspaper. 
Try to conduct the interview in as natural a manner 
as you Gan» Introduce yourself and close the inter*- 
view in an appropriate manner* Remember^ I cannot 
understand or speak English very well, so this inter- 
view must be conducted in (the foreign language)^ 
Take notes in English as you ask me questions* At 
the end of .the interview^ write in English all you 
have found out about me* Try to obtain the following 
information J (This should be given to the students 
in English*) 



1. My name ^ 

IS 

2. Whore I come from in the foreign country^ 

3. Mv'ith whoi%I am staying in the U.xS, 

4» What cours(|S I plan to take at vtjur school 

5. , How long I will stay in the u".S» ^ 

6. iVhcrc I plan to travel in the U»S» during 
• school vacations 

7. If I would like to live here 

8. When 1 plan to return to my home 
9^ What my career plans are 

10^ My first impressions of the U.S. 

Suggested Scoring: Assign points to each item of 
information satisfactorily included in the student *s 
summary of the intervie\v. 



Content Validity 

Content validity refers to the ability of a tost to mea- 
sure what has been taught and subsequently learned by the 
students. It is obvious that teachers must see that the 
test is designed so that it contains items that correlate 
with the content of instruction. Thus^ it follows that 
unless students are given practice in oral coimnunication 
.in the foreign language classroom^ evaluation of communi- 
cation may not be valid^ unless it is asst^mcd that the 
grammatical practice done in the classroom will automatic- 
cally result in the ability to use the language on a' 
coimruriigative . ^.1^ Research has shown, however^ that 
sucTr*tm assumption is not tenable. 

In addition, in order to ensure content validity, the 
level of instruction must, of course, also be taken into 
account when constructing a test. The evaluation of oral 



conununication can be carried out from the very earliest 
stages of instruction if certain basic guidelines aio 
followed, 

♦ 

Oral Communication Tests for 
, the Beginning 'Levels 

Testing oral coinmunication at the beginning levels of 
instruction must, of course, bo confined to items that 
will require a limited amount of vocabulary or structural 
complexity. The description of visualc or realia is 
probably the easiest technique for enrly language- learning 
evaluation. Simple oral descripticns involving a simu- 
lated communicative situation will provide a good test of 
vocabulary and '-■tructure. For example, the teacher, can 
provide magasine or newspaper cutouts in several areas or 
categories, such as clothing, foods, sports, etc. Using 
the items of clothing, the student con pretend he or she 
is a commentator at a fashi-on show and must say at least 
one thing about each picture. Or in the case of the 
sports visuals, the student can be a IV sports commentator 
who must describe' the action in each picture with at least 
one sentence. It should be pointed out that the teacher 
should mot expect a large amount of speech at this level, 
but evaluation of this type from the very outset of lan- 
guage instruction will put so.ao emphasis on the ability to 
use the language spontaneously rather than focusing only 
on tltc ability to manipulate the language correctly. 

In another possible procedure for testing at the beginning 
levels, one student describes a simple line drawir of an 
object while the other members of the class are required 
to draw the object based on the student *s description. Or", 
a student describes one of a series of pictures visible to 
the entire class, who select the picfre the student is 
attempting to desciibe. 

Tests that attempt to evaluate the ability to "converse" 
at this level could involve the interview technique 
described earlier in which the student is required to 
obtain information from the teacher or another student. 
Topic matter av.d content would, of course, have to be 
adapted to the beginning levels of language learning. For 




^ example^ if a unit on foods and meals has just been com* i 
plete<J^ the following interview test item could be admin- 
istered: 

^ Pretend you are a doctor and you need to find out the 
following information from your patient (the teacher): 

1^ Does (s)he drink milk? 

2* How much? 

^ 3* Does (s)he eat breakfast? 

4* What does (s)he usually eat for breakfast? 

5* When does' (s)he eat dinner? 

6* How often does (s)he eat vegetables? 

Students can receive the above instructions in English and 
carry out their interview exercise with the teacher^ 
Scorii^^g can be based on a written summary in English* 

Evaluation of oral cotonunication at the beginning levels 
of lanc^uage can be carried ^^ut if careful and creative 
planning is involved and if the teacher keeps in mind that 
such evaluation must be structured and that the student 
must be given explicit instructions. Although tests of 
oral coimnuni cation are designed to evaluate the ability of 
the student to use the language spontaneously and freely^ 
this does. not mean that such tests should be unstructured* 
Teachers in the past have found it difficult to evaluate 
**free exgression'*--- especially at the earlier levels-- 
because they have <*quated such exercises with 'an ^^openness'^ 
or a lack of structure* To instruct the student to '^talk 
about something'' u>:ually results in a long silence. 

In sumiriary> three basic points need to be considered in 
the construction of beginning-level oral coimnuni cat ion 
tests: 

Ehvphasis should be« on simple descriptive exercises^ 
based on vocabulary and structure presented in 
tlass* 

In order to provide content validity^ practice in 
description or obtaining information should be 
carried out oefore testing*. 

Beginning oral communication* tests mu<>t be highly 
structured ^and include explicit directions and 
clearl)^ outlined tasks^ 

8 * 
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Oral Communication Tosts for tho 
1 n t omed ia t o-Advanc ed Levol $ 



At the intermediate and advanced levels of instruction, 
the three points above are still important, but the 
range of possibilities for test items increases* Both 
monologue and conversational techniques are again possible 
at the advanced levels, including descriptions of visuals 
or realia and the interview technique at a more difficult 
level* However J at the more advanced levels, much more 
emphasis can be put upon the simulation of communicative 
situations. Examples of such test items, which involve 
specific situations in the foreign culture, appear through*- 
out this paper and can also be found in binder (1977)* 

Some additional examples of test items that utilise a 
coitiiwnicativo situation and that are appropriate for the 
intermediate and advanced levels are described below* 

Titled SHOPPINC; IN A FOOD MARKI:T 

Proparat ion : The teacher prepares a set of index cards 
on which pictures of grocery items are drawn or 
pasted* 

Instructions to the Studen t: You are in a German 
(French* Spanish, etc*) food market* You have com- 
pleted all your shopping except one item, for which 
you cannot rem^^^ er the (foreign language) word* A 
picture of the item is on the index card you have 
selected from a pack of cards* Describe the item to 
the ^'clerk'^ (teacher) so that he or she will be able 
to find it* (The teacher cannot see the card that 
the student is describing and must try to select the 
correct item based on the student's description*) . 

Scoring : The teacher may use one of the rating scales 
described on pp* 18-22, or may assign points based 
on the nuinl!>er of ''tries'* the student had to make 
before he or she could find the item, e*g*, the 
teacher identifies the item pn the first try--10 
points; on the second try— 8 points; etc. 

Variation* This test item can also be carried out 
with a second student playing the role of the clerk; 



however, it should be noted that in this situation, 
scoring reliability may Le a problem, and the 
"clerk's" listening comprehension ability becomes 
another variable of the test. (Based on Lindcr 1977) 



Title : AT THE TRAViiL AGHMCY 

Preparation : The teacher acquires a number of maps of 
" France (GcnA&ny, Sp'iin, etc.) and on each outlines 
in red a different route that the students will 'se 
to describe their planned trip. The teacher should 
keep one unmarked map on which he or she can trace 
the trip as the student describes it. 

Instructions to the Student : You are in a travel 
agent ♦s office iji (the foreign cour),try). In front 
of you, you have a map ot! (the ap|iropriate country). 
On the map you will see aNs^d^^ne showing where you 
plan to travel. Also indicated on the map are the 
number of days you plan to spend in each city. You 
want to travel by train and must explain to the 
travel agent (teacher) exactly where you^plan to go 
and the number" of days you want to stay at each loca- 
tion, so that the agent can issue your train tickets. 

- Scoring : The teacher may use one of the rating scales 
described oji pp. 18-22. or may assign points to each 
segment of the trip that the student explains sue-- 
cessfully. 



Title :, MAKING A DOCTOR'S APPOTNTMliNT 

Preparation ; The teacher prepares a set of several 
cards on, which are listed at least five symptoms (in 
English) of an illness, e.g., a bad cold, flj, chicken 
pox, mumps. 

Instructions to the Student : You are living in (the 
foreign country) and have suddenly become quite ill. 
You call the doctor to make an appointment. In your 
conversation with the nurse (teacher) you must 
describe your symptoms, in (the foreign language), 
which are written in English on V card your teacher 
will give you. Pretend you are on- the phone setting 
up your appointment. 

O 10 . 
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Scoring : The teacher may use one of the rating scales 
described on pp^ 18-22 or may assign points to each 
symptom that the student coiMunicates sux.>-essfully 
to the ^^nurse.'' 



Title: WITNESS TO AN ACCIDENT 



Preparation : The teacher prepares a set of visuals 
containing diagrams of various accidents involving 
automobiles^ buses, bicycles, pedestrians, etc. The 
visuals should show the direction in \vhich the 
vehicles ivere traveling, point of impact, and other 
relevant details ♦ 

Instructions to the Student : You have been standing 
at a corner in (foreign city), waiting to cross the 
strefet, when suddenly you see an accident* A police 
officer arrives, and you are asked to describe what 
happened^ In front of you, you have a visual depic- 
ting the accident. Describe the accident to the 
ix^lice officer (teacher)* 

Scoring : The teacher may use one of the rating scales 
described on pp, 18''22. The ''Amount of Communica- 
tion*^ scale may be especially appropriate for this 
item. 



The use of a communicative situation not only provides a 
setting in which the student can perform, but also enhances 
the credibility and relevance that students view as lacking 
in many foreign language classes^ The relationship 
between the abstract components of language learning and 
the real world of communication is not very clear to many 
students* The testing of oral coinmunication in the class- 
room can help to promote an understanding of this rela- 
tionship* Thus, one of the goals of testing on the more 
advanced levels should be to involve students as much as 
pbssible in tasks that will require them to demonstrate 
their ability to function in the real world of communica- 
tion* Tests that simulate such *^real^' situations can 
provide for a better understanding of what the ultimate 
tasks in language performance will be* 
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Administration 



With time at a premium^ teachers must consider ho\v long it 
takes to administer tests. Evaluating the listening skill 
in isolation* as illustrated by the two listening tests 
described earlier, can be done by adminii^tering the test 
to the class as a whole* Tests that evaluate the speaking 
skill or the integration of the listening and speaking 
skills on a communicative level are iiiore complex to admin^ 
ister% Tests that measure speaking on a communication 
level, by their very definition, will almost always have 
to be administered on an individual basis. 

Recording student responses in a language laboratory might 
be feasible for the testing of speaking at this level, but 
this procedure would diminish the face validity of the 
test by creating an unrealistic activity in terms of 
communication^ In the study conducted by Schuls (1974)^ 
it was found that students view testing procedures 
requiring responses to be recorded not only as unrealistic 
and artificial * but also as highly threatening* Teachers, 
therefore, may need to reassess priorities in order to 
allow some time for individual evaluations* They will 
find> perhaps to their surpri.,e, that speaking tests such 
as those cited earlier can be administered rapidly while 
the rest of the class is involved in some other activity^ 



Scori ng 



Any activity that purports to be a test must involve a 
scoring procedure^ In scoring a test that claims to 
measure a student ability to communicate, disv ^ete 
errors cannot be the primary criteria by which success*^ (or 
^xla^k of it) is calculated* Rather, the criteria must be 
based on the student ability to produce or comprehend a 
message in the foreign language* This will involve a 
certain degree of subjectivity on the part of the tester* 
The question that must be dealt with, especially in the 
evaluation of the speaking skill, is to what degree dis- 
crete errors interfere with the intended message of the 
speaker* Clark (1972) suggests that communicative and 
linguistic criteria not be mixed in the evaluation of 
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coimnunicative ability. He believes that this mixture 
"serves only to obsctire the distinction between the two 
types of measurement and decrease the validity of the test 
as a direct measure of communicativG proficiency," How- 
ever, as Schulz and Bart 2 (1975) point out. 

It is difficult to totally separate the two ^ 
criteria, as the linguistic quality of an 
utterance can influence comprehensibility, the 
^ basic communicative criterion. Further, while 
a major goal of most college or secondary 
language programs is communicative ability in 
the target language, there is a justifiable 
concern with linguist^ correctness because 
. » . we are not just attempting to teach sur- 
vival communication , , we are also tr>'ing 
to teach literacy in another language* 

> 

The scoring of pure listening items can be carried out with 
relative ease and objectivity as illustrated in the test 
item below. 

Listening Test 

Pretend you have just arrived in (the foreign country) 
and after being there for several days, you are 
invited by your host to a party given by some of his 
or her friends. During the party you overhear the 
following conversation. While listening, jot down in, 
English the following information: 

1, What exam both have to study for 

2, What the girl must do in addition to studying 

3. When she might do this 

4. When the boy suggests they study 

5. What else the boy wants to do 

6, The girl's final suggestion 

Administration ; Students hear the following conver- 
sation (in the foreign language) twice: 
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Boy: Do you have any plans for this weekend? 

Girl: No, but I will have to study for an exam 
in Latin* 

Boy: So do maybe we can get together some- 
time to study? 

Girl: Well^ I don't really know right now 
exactly when lUl be able' to study ^ 
because I just remembered, I also have 
to go shopping with my mother* 

Boy: When are you going shopping? 

Girl: Maybe Saturday afternoon^ 

Boy: Could we study Sunday afternoon and then 
go to the movies around seven? 

Girl: Why don^t you give me a call and we ^11 
decide then? 

Boy: 0*K», lUl call you in the morning. 



The scoring of the inte>n;iew test previously cited, in 
which the student must solicit information, can be carried 
out simply by checking the student^s account in English of 
the information he or she obtained through the interview* 
However jT^the types of speaking tests in which students 
provide information must involve some sort of evaluation 
scale for the purposes of scoring* The following test, 
which requires the student to describe, a series of car- 
toons, requires scoring based on such a scale* 



Description 

You will see k series of drawings which tell a story 
about a day in the life of a college student* Take a 
minute to look over the drawings and to organize your 
thoughts* Then tell the story in (the foreign language) . 
Say as much as you can* Use your imagination to add 
whatever details you wish, even though they might not 
be pictured* You will not be interrupted* (Pictures 
on next page*) 




Scoring : The teachor is, instructed to use a scale chat 
is attached to the test to rate the student on the 
amount of conununication . A definition of the scale is 
also attached, \.hich the teacher is asked to read before 
administering the test item (Schuls 1974) . 



Rating Scales 



If the primary behavior being measured is speaking, the 
scoring procedure will almost always have to be based on 
Some type of rating scale. Recently, many different types 
of rating scales have been developed for the purpose of 
evaluating oral communication* ITie Foreign Service Insti- 
tute, for example, has developed a six-point rating scale 
for each of five language areas: pronunciation, grammar, 
vocabulary, fiuejicy, and comprehension. The Foreign 
Service Interview, described by Clark (1972), uses five 
"levels'* ranging from "elementary proficiency" (able to 
satisfy routine travel needs and minimum' courtesy require- 
ment's) to "native or bilingual proficiency" (speaking pro- 
ficiency equivalent to that of an educated native speaker). 

This scale has also been defined in more detail in a pub- 
lication that contains the proceedings of a two-day confer- 
ence on the testing of speaking proficiency conducted by 
the Educational Testing Service (Clark 1978). This report 
contains three papers that are especially useful for 
adapting the FSl Interview scales and levels for classroom 
use. Reschke (1978) proposes that a modification of the 
FSl Interview Scale be made to overcome two basic problems: 
(1) the administration of the test, which requires two 
persons, and (2) the broad range of the FSl scale, which 
becomes meaningless in testing high school or college 
students who have only limited oral proficiency. Reschke 
suggests that the testing team be reduced to one person 
and that the scale be modified to "fine tune" each FSl 
level by adding a horizontal scale or decimal system of 
numbers to subdivide each level. ' Tius, if a student falls 
somewhere between two levels on the FSl scale, a more pre- 
cise and refined evaluation can be made. Reschke also 
provides a description for each of these "fine-tune levels," 

Albert (1978) describes the testin^j program in the' J^ew 
Brunswick senior high schools, where the FSl scale is 



used with hardly any modification* Although the scale is 
apparently used successfully, it requires a rather exten^ 
sive teacher- training program* which is * conducted oy ETS 
and described in the paper^ 

Graham (1978) describes an ^^FSI Diagnostic Feedback*^ 
checklist developed by the Language Training Mission in 
Provo, Utah* Based on the five language areas evaluated 
by the FSI rating soale, this checklist is designed to 
point out specific deficiencies in graimnar, vocabulary, 
comprehension > fluency^ and pronunciation* The test is 
conducted in the same manner as the regular FSI interview, 
but" scoring is done by means of the checklist rather than 
the FSI levels of proficiency^ The French example 
included in the paper illustrates how the teacher can 
focus on specific speaking problems in a much more objec- 
tive way than a simple rating scale would allow* 

Savignon (1972) uses different criteria to evaluate dif-* 
ferent parts of her oral communicative competencies test* 
She employs six^point scales ranging from ^^noneV to '^great*^ 
for such criteria as effort to conmunicate, amount of 
communication, comprehensibility, naturalness and poise, 
^nd fluency. 

In their textbook French for Mastery (197S), the Valettes 
suggest a five-point scale for evaluating oral question/ 
answer exercisers: 

4 points i The student answers accurately and without 
hesitation* 



3 points: The student answers accurately but with 
hesitation or after having the sentence 
repeated* 

2 points: The student gives the wrong answer on the 

first try, but answers without hesitation on 
the second attempt* 

1 point: The student answers accurately but with 
hesitation on the second attempt* 

0 points: The student gives the wrong answer on both 
attempts* 
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Schulz and Bart2 each use similar scales for the evalua- 
tion of oral cairnunication: fluency, quality of communi- 
cation, amount of communication, comprehcnsibility, and 
effort to communicate. In the Bartz study, two aativc 
speakers of German evaluated 50 high school German students 
with a reliability of ,99 among raters. The "amount of 
communication" scale served as the best predictor of the 
students* total score on. the^ coimkmicativo tests adminis- 
tered. Below is a description of this scale, along with a 
definition of each of the five levels: 

♦ AMOUNT OF COMMyNlCATION 

General definition: The quantity of information rele- 
vant to the communictUion situation the student is able 
to convey 

Definition of each level on the scale: 

1. Virtually no relevant information was conveyed 
by the student, 

2* Very little relevant information was conveyed by 
the student. 

3. Some relevant information was convoyed by the 
student* 

4* A fair amount of relevant information was con- 
veyed by the student. 

5. Most relevant information was conveyed by the 
student* 

6* All relevant information was conveyed by the 
student. (BartE 1974) 

The reader may want to refer to the other rating scales 
below used in both the Bartz (1974) and the SchuU (1974) 
studies; however , for the purposes of classroom evalua- 
tion, the ^^amount of communication** scale may be adequate, 
since; as pointed out earlier, this scale had the highest 
correlation with the total score on the oral communication 
tests given in the Bartz study^ 

The five scales described below could be used either 
separately or in combinationj, depending upon whether or 
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not the teache^r is intei^ested in evaluating certain ast^ects 
of oral coimnunication more specifically^ Each of these 
scales has been used in the studies referred to above^ and 
^ a number of statistical procedures have been used to 

determine reliability among raters, scoring validity, etc* 

FLUENCY (adapted from FSl rating procedures) 

General definition: Fluency does not refer to 
absolute speed of delivery, since native speakers 
of any language often show wide variations in this 
area. Fluency refers to overall smoothness, con- 
tinuity, and naturalness of the student's speech, 
as opposed to pauses for rephrasing sentences, 
gropinjp for words, and so forth. 

Definition of each level on the scale: 

1* Very many unnatural pauses, very halting and 
fragmentary delivery ^ 
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Quito a few unnatural pauses, frequently halting 
and fragmentary del ivery 

3* Some unnatural pauses, occasionally halting and 
fragmentary delivery 

4* Hardly any unnatural pauses, fairly smooth and 
effortless delivery 

5. No unnatural pauses, almost effortless and 
smooth, but still perceptibly non-native 

.6* As effortless and smooth as speech of native 
speaker (BartE 1974) 

B . COMPREHENSIB I LITY 

General definition: The ability of the student to 
make himself understood, to convey meaning 

Definition of each level on the scale: 

1. No comprehension, couldn't understand a thing 
student said 
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2* Comprehended small bits and pieces^ isolated 

3. Comprehended some phrases or word clusters 
4* Coaiprehe^^ded short, simple sentences 

S% Comprehended most of what student said 

6» Comprehended all of what student said (Schulz 
1974) 

AJ40UNT OF COMMUNIQATION (described above) 
QUALITY OF COMMUNICATION 

General definition: The grammatical correctness of 
the student's utterances 

Definition of each level on the scale: 

K No utterances rendered correctly 

2» Structure of very few utterances rendered 
correctly 

3* Some utterances rendered correctly, but many 
structural problems remain 

4, Many correct utterances^ but some problems 
remain with structures 

5* Most utterances rendered correctly; only minor 
problems with structure 

6. All utterances rendered correctly (Schulz 1974) 

EFFORT TO COMkfUNICATE 

General definition: The student^s willingness to 
express himself and to get his message across* How 
hard does the student try to make himself under-- — 
stood? Does he make any attempt to express himself? 
Does he use gestures to help express himself? Or 
does he withdraw into an embarrassed silence that 
makes it very difficult for him to communicate at 
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all? Ask yourself this question: To what degree 
does the student show an effort and a willingness 
to express himself in [German]? 

Definition of each level on the scale: 



Student makes little effort to communicate^ 
doesnH seem to Cs^re if he completes the task 

Student makes some effort to communicate^ but 
doe J not try very hard to complete the task 

Student makes an effort to communicate^ tries 
to complete the task, may add something not 
required by the task 

Student makes a real effort to conmiunicate> 
tries very hard to complete the task, may add 
something not required by the task 

Student makes a special effort to communicate, 
shows an extremely high effort to complete the 
task, and goes beyond the required task 

Student makes an unusually high effort to com- 
municate, shows an almost over- zealous effort 
to complete the task, gfoes way beyond tlie 
required tasjv, and uses all possible resources 
verbal and non-verbal, to express himself 
(Bartz 1974) 

As suggested above, the "amount of communication" scale 
alone may be adequate, because it .would probably be diffi 
cult, if not impossible, for the classroom teacher to 
evaluate* the student's performance using all these scales 
^simultaneously* Or the teacher could select any one of 
the other scales above, depending on what aspect of oral 
conununication he or she wishes to evaluate more specif- 
ically, A ra.ting sheet as shown below may, however, 
facilitatfe simultaneous scoring, which can be done after 

the' teacher has had practice using the scales separately. 

•» * 

A. FLUENCY 

I 2 ' 3 4 5 ' "6"""^ 
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B, COMPREHENSIBILITY 



c. 


1 2.3 
AMOUNT OF COMMUNICATION 


4 


S 
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1 2 3 
QUALITY OF CpMMUNI CATION 
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1 .2 3 
EFFORT TO COMMUNICATE 


''a 


5 


6 
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4 


5 


6 





* ^ * 



The purpose of ^ this paper has been to illustrate some ways 
of evaluating oral communication in the foreign language 
./classroom* The evaluation of the oral skills on ^a linguis- 
tic level has been developed and carried out extensively 
over the past several decades; however^ expertise in 
evaluation of the oral skills on a coimnunicative level is 
still limited despite a recognised need for such testing/ 
The development of instruments that will evaluate students* 
oral skills on a communication level needs to be refined 
and expanded so that classroom teachers can employ pro* 
cedures that will indeed reflect the major goal of foreign 
language instruction— the ability to communicate in the 
foreign language. As Rivers (1973) has stated^ ^'Let us 
remember that by our testing they ihall know us^ far better 
than we shall know them,^' 
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